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Abstract 

The consideration of nonstandard models of the real numbers and 
the definition of a qualitative ordering on those models provides a 
generalization of the principle of maximization of expected utility. It 
enables the decider to assign probabilities of different orders of mag- 
nitude to different events or to assign utilities of different orders of 
magnitude to different outcomes. The properties of this generalized 
notion of rationality are studied in the frameworks proposed by von 
Neumann and Morgenstern and later by Anscombe and Aumann. It is 
characterized by an original weakening of their postulates in two dif- 
ferent situations: nonstandard probabilities and standard utilities on 
one hand and standard probabilities and nonstandard utilities on the 
other hand. This weakening concerns both Independence and Conti- 
nuity. It is orthogonal with the weakening proposed by lexicographic 
orderings. 

*This work was partially supported by the Jean and Helene Alfassa fund for research 
in Artificial Intelligence and by grant 136/94-1 of the Israel Science Foundation on "New 
Perspectives on Nonmonotonic Reasoning" . 
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1 Infinitesimal probabilities 



Suppose you are considering playing dice. You have to choose between bet- 
ting on six (b6) and betting on four (b4)- The sums won are the same. You 
experiment with the dice and come to the conclusion that the chances of the 
dice falling on six are equal to those it falls on four. You conclude that you 
are indifferent between b6 and b4- You are now offered a third bet (e6): you 
win if the dice falls on six or falls on one of the (twelve) edges. You ponder 
the chances of the dice falling on an edge and conclude that they are too 
small to make you prefer the bet e6 to b4- You are indifferent between b4 
and e6. Since you believe in the transitivity of indifference, you conclude you 
are indifferent between e6 and b6. 

You now consider two more bets. In e, you win a large sum if the dice falls 
on any one of the edges. In /, you win the same sum if the dice falls on the 
edge that lies between face six and face five. You decide you prefer bet e to 
bet /. 

According to the theory of rationality proposed by von Neumann and Mor- 
genstern ||19| , you are irrational. If you are indifferent between e6 and b6, 
it must be that you give subjective probability zero to the event of the dice 
falling on one of its edges. In this case, you must be indifferent between e and 
/. You may certainly be rational and indifferent between e and f, but must 
any rational decider be such? This work suggests the preferences above can 
be explained by choosing some number e, positive but infinitesimally close to 
zero (as in Robinson's fL5|), and assigning a subjective probability of to 
the dice falling on any of its faces and a probability of to the dice falling 
on any one of its edges. The numbers and ^ + e are qualitatively (the 
term will be formally defined below) equivalent. The numbers e and ~ are 
not qualitatively equivalent. 

2 Infinitesimal utilities 

Here is a different example. Suppose you have to choose between two lotter- 
ies. In the first lottery you may win, with probability p, a week's vacation 
in Hawaii. With probability 1 — p you get nothing. In the second lottery 
you may win, with the same probability p, the same vacation in Hawaii, 
but, with probability 1 — p you get a consolation prize: a free copy of your 
favorite magazine. Since the free copy is preferred to nothing, von Neumann- 



Morgenstern's independence postulate implies that lottery two is preferred 
to lottery one. But couldn't a rational decision maker be indifferent between 
the two lotteries? One, often, I think, buys a lottery ticket in a frame of mind 
focused on the big prize and not on the consolation prize. This behavior is 
by no means general, as attested by the fact lotteries often offer consolation 
prizes, but should a decision maker indifferent between the two lotteries be 
considered irrational in all situations? I think not. 

A variation on this example considers also a third lottery, in which one 
wins a trip to Paris with the same probability p as above, and nothing with 
probability 1 — p. Suppose you try to compare lotteries one and three. You 
ponder at length the advantages and disadvantages of the two vacation spots, 
and decide you are indifferent between the trip to Hawaii and the trip to Paris, 
all relevant considerations taken into account. You conclude that you are also 
indifferent between the lotteries one and three. The Independence axiom of 
von Neumann and Morgenstern implies that lottery two is preferred to lottery 
three. But it has been argued that it is quite unreasonable to expect the very 
slight improvement that lottery two presents over lottery one to overcome the 
lengthy and delicate deliberation that made you conclude that the trips to 
Hawaii and Paris are equivalent for you. 

Similar examples have been put forward to argue that the indifference rela- 
tion is not always transitive: lottery three is equivalent to lottery one and to 
lottery two, but lottery two is preferred to lottery one. The system presented 
in this paper endorses the transitivity of indifference, but allows a decision 
maker to be indifferent between lotteries one and two. 

This work proposes to consider that the utility you attach to the trips to 
Paris and Hawaii are equal, say 1. The utility you attach to the free copy 
of your favorite magazine is e, some positive number, infinitesimally close to 
zero. The utility of lottery one and of lottery three is p, that of lottery two 
is p+ (1 — p)e, which is qualitatively equivalent to p. Nevertheless, the free 
copy of the magazine has utility e, that is not qualitatively equivalent to zero. 

3 Infinite utilities 

Let us consider yet another situation. A patient has to choose between two 
options: 

1. (option p) do nothing and die in a matter of weeks, 



2. (option q) undergo surgery, the result of which, depending on some 
objective probabilities, may be a long and happy life (denoted by I) or 
an immediate death on the operation table (denoted by d). We shall 
denote by A the probability of the surgery being successful, i.e., the 
probability of I. The probability of death on the operation table is, 
therefore, 1 — A. 

In other terms, one has to compare mixtures p and A I + (1 — A) d. Assuming 
one prefers I to p and prefers p to d, von Neumann and Morgenstern's postu- 
lates imply what we shall call property P: there is a unique A e]0, 1[ for which 
one is indifferent between p and A I + (1 — A) d. For any p > A, one prefers 
p I + (1 — p) d to p, and for all p < A, one prefers p to p I + (1 — p) d. If one 
thinks that a long and happy life is overwhelmingly preferable to p so as to 
make the distinction between p and d insignificant, i.e., that pi + (1 — p) d 
is preferable to p for any p e]0,l[, property P fails and one deviates from 
von Neumann-Morgenstern's rationality postulates. 

But would we really dismiss as irrational such a behavior, or such a pref- 
erence? The consideration of an infinite utility for I explains the preference. 
Von Neumann-Morgenstern's point of view is perfectly acceptable and I have 
no criticism for someone who adheres to it and decides there is indeed some 
p, very close to zero, perhaps, such that p is equivalent to p I + (1 — p) d. 
My only claim is that someone who thinks p I + (1 — p) d is preferable to p 
for any p e]0, 1[ cannot be considered irrational outright. 

An argument, very similar to the one just presented, for prefering a mixture 
pw + (1 — p)d to some p, for any p e]0, 1[, even though p is preferred to d, 
appears in Pascal's fll4H . There w denotes eternal bliss (the reward of the 
believer if God exists), d denotes a life spent in error by a believer in a 
God that does not exist, and p denotes a life spent by a non-believer. This 
argument, known as Pascal's wager, is very well-known and the reader may 
find in a detailed discussion in | jl3[| . 

A number of papers [H, [Tj| |2[ discussed, in the setting of the St. Petersburg's 



paradox, the existence of unbounded utilities. In the last of these papers, 
Aumann argues very convincingly that utilities should be bounded. At first 
sight, one may think that infinite utilities imply unbounded utilities, and 
therefore Aumann argues also against infinite utilities, but this is not the 
case. His argument may be summarized in the following way: if utilities 
were unbounded, for any A e]0, 1[ there would be a consequence (c) such 
that a lottery Ac+ (1 — A) d is prefered to a long and happy life (I). But 



this seems very unreasonable to Aumann. His argument is directed against 
unbounded utilities, but ineffective against infinite utilities. Certainly, no 
consequence is infinitely preferable to I and therefore, if there are infinite 
utilities, the utility of / is infinite. But there is absolutely no problem if one 
assumes that the utility of / is infinite and maybe even maximal (nothing is 
prefered to I). In this case, Aumann's argument disappears. The fact that / 
is infinitely prefered to some other consequence, d for example, or a sum of 
money, will influence the preferences of a decider between lotteries involving 
/ and consequences such as d. 



4 Background 

Utility theory is discussed in the framework of [^, Chapter 3], see also 0. 
Let 7i be a boolean algebra of subsets of X, and P a convex set of probability 
measures on Ti.We assume that P is finitely generated. Convex means here 
that: 

Vp, q e P, VA g]0, l[, Xp + (1 - X)q e P. 

Here ]0, 1[ denotes the open real interval in some model, maybe nonstandard, 
of the real numbers. 

Von Neumann and Morgenstern have characterized the binary relations > 
on P that can be defined by a linear functional u on P, when ]0, 1[ is the 
standard interval, in the following way: 

\/p, q G P, p > q 43- u(p) > u(q). (1) 

In Equation |J the functional u is a function from P to the standard set of 
real numbers R and the relation > in the right hand side is the usual strict 
ordering on R. 

Their characterization is equivalent to the following, due to Jensen |3j 
(see 0, p. 1408]) three conditions, for all p,q,r G P and all A G]0,1[ (a 
weak order is an asymmetric and negatively transitive binary relation): 

Al > on P is a weak order, 

A2 p > q =^ Xp + (1 - A)r > Xq + (1 - A)r, 



A3 (p>q,q>r) =3- 3a, (3 g]0, 1[, such that 



ap + (1 — a)r > q > 0p + (1 — (3)r. 



The three conditions above are not the original postulates of von Neumann 
and Morgenstern, they are equivalent to them. They will be referred to, nev- 
ertheless, in this work, as von Neumann and Morgenstern's postulates. The 
purpose of this work is to generalize von Neumann and Morgenstern's char- 
acterization to deal with qualitative probabilities or with qualitative utilities. 
In the sequel, p > q will denote q ^ p and p ~ q will denote the conjunction 
of p > q and q > p. 



5 Qualitative Decision Theory 

Qualitative decision theory has been developed mostly in opposition to quan- 
titative decision theory, stressing decision methods that do not satisfy von 
Neumann-Morgenstern's or Savage's |16| postulates, the postulates generally 



accepted for quantitative decision theory. The focus in qualitative decision 
theory has always been on methods and algorithms, more than on an ax- 
iomatic treatment ([[|] is an exception). 

A different approach is proposed here: qualitative and quantitative deci- 
sion theories can be viewed as special cases of a unified general theory of 
decision that contains both. This unified theory is a generalization of the 
quantitative theory. The power of the generalization lies in the consideration 
of nonstandard models of the set of real numbers for utilities and a definition 
of indifference that neglects infinitesimally small differences. In this paper 
probabilities will always be standard. Some first results, for nonstandard 
probabilities and standard utilities have been presented in [O]. Preliminary 
ideas appeared in . 



A well-established tradition in Decision Theory considers Expected Utility 
Maximization as the only rational policy. Following this view, an act / is 
strictly preferred to an act g iff the utility expected from / is strictly larger 
than that expected for g. Since expected utilities are real numbers, strictly 
larger has its usual, quantitative meaning. The main claim of this paper is 
that the qualitative point of view may be subsumed by a slightly different 
definition of strictly larger. Suppose we consider any model elementarily 
equivalent to the real numbers, more precisely, any (standard or nonstandard) 
model of the real numbers, 1Z (for the standard model, we shall use R) . Let 
x and y be elements of 1Z. To make matters simpler, suppose that both x and 



y are positive. The number x is quantitatively larger than y iff x — y > 0. 
What could be a reasonable definition of qualitatively larger! Clearly, if 
x is qualitatively larger than y then it must be quantitatively larger: in 
a sense qualitatively larger means definitely larger. A first idea that may 
be considered is to use a notion that proved fundamental for nonstandard 



analysis (the monads of [15], or see [10]): the notion of two numbers being 



infinitely close, and consider that a number x is qualitatively larger than a 
number y iff x is larger than y and not infinitely close to y, i.e., iff x — y is 
strictly larger than some positive standard number. At first this idea looks 
appealing: if e is strictly positive and infinitesimally close to zero, and x is 
a standard, strictly positive, real, we do not want x + e to be qualitatively 
larger than x. At a second look, one realizes that the size of x — y should not 
be judged absolutely, but relatively to the size of x: for example e 2 + e should 
be qualitatively larger than e 2 . Therefore I propose the following definition: 

Definition 1 Let x and y be positive. We shall say that x is qualitatively 
larger than y and write x >- y iff is strictly positive and not infinitesimally 
close to zero: in other terms, iff there is a strictly positive standard number 
r such that > r. 

x — 

The definition may be extended to arbitrary numbers in an obvious way: 

1. if x > and > y, then x y y, and 

2. x >~ y iff — y > x, 

x d y shall denote x )f y and x ~ y shall denote that x <y and y -< x. 

Notice that, if we choose, for 7Z, the standard model of the reals, R, then 
x >- y iff x > y. Therefore our treatment would include the classical ap- 
proach, if we allowed also negative utilities. As said above, in this paper, 
we concentrate on the case all utilities are positive. Is our framework, with 
positive nonstandard utilities, a generalization of the classical theory, with 
standard positive and negative utilities? Since, in the classical setting, utili- 
ties are defined only up to an additive constant, bounded utilities may always 
be considered to be positive, by adding a positive large enough constant. In 
view of Aumann's critique of unbounded utilities, we feel that the present 
framework encompasses the most important part of classical theory. 

Notice also that Definition [I] relies on the notion of a nonstandard number, 
and that notion is not first-order definable. 



Expected Qualitative Utility Maximization, the paradigm of rationality 
proposed here is the version of Expected Utility Maximization that obtains 
when, for probabilities and utilities, 

• the models chosen for the real numbers may be nonstandard, and 

• real numbers are compared qualitatively, i.e., by >-. 

At this stage, I do not know of an axiomatic characterization of Expected 
Qualitative Utility Maximization in its most general form: nonstandard prob- 
abilities and utilities. But two orthogonal special cases have been character- 
ized in full: first, the case in which probabilities may be nonstandard but util- 
ities are standard and secondly, the case in which probabilities are standard 
but utilities may be nonstandard. In the first case, we want to characterize 
the binary relations > on P that can be defined by a functional u : P — > R 
into the standard real numbers in the following way: 



Vp, qeP,WX G]0, 1[, u(\p + (1 - X)q) ~ \u{p) + (1 - X)u(q). (3) 



In Equation [| the interval ]0,1[ may be non-standard and therefore the 
right-hand side of the equivalence may be nonstandard. This case is treated 
in Section [?]. 

In the second case, we characterize the binary relations > on P that can 
be defined by a linear functional u : P — > 1Z + in the following way: 



Here the interval ]0, 1[ is the standard one. This case in treated in Section || 
One should immediately notice that, if c > 0, the utility function c u(p) 
defines the same ordering as u(p), and is linear or pseudo- linear iff u is. 
But, contrary to what happens in the classical setting, if d G TZ the func- 
tion d + u(x) does not, in general, define the same ordering as u(p). Such 
an instability under an additive constant, and in particular an asymmetry 
between gains and losses has been found in the behavior of decision makers 
in many instances || || |17|. The question of whether Expected Qualitative 
Utility Maximization is a realistic model for explaining such behavior cannot 
be discussed in this work. 



Vp, q G P,p > q u{p) > u(q) 



(2) 



and u is pseudo-linear, i.e.: 



Vp, q € P, p > q u{p) y u(q). 



(4) 



6 Maximin as Expected Qualitative Utility 
Maximization 



Considering nonstandard utilities enables us to obtain decision criteria that 
do not satisfy von Neumann-Morgenstern's postulates and were so far con- 
sidered as part of the realm of qualitative decision theory. 

As noticed above, Expected Qualitative Utility Maximization generalizes 
Expected Utility Maximization: if one chooses the standard model for real 
numbers then Expected Qualitative Utility Maximization boils down exactly 
to Expected Utility Maximization, at least when utilities are bounded. We 
shall show now that considering nonstandard utilities enables us to obtain 
decision criteria that do not satisfy von Neumann-Morgenstern's postulates 
and were so far considered as part of the realm of qualitative decision theory. 
A version of the Maximin criterion will be presented. The Maximin criterion 
has been proposed by A. Wald [p0[| , in a different framework. The criterion 
to be presented is a variation on this theme. 

Assume the set X is finite and Ti contains all subsets of X. Let the elements 
of X be xo, ... , x n-i- Let e be a number that is positive and infinitesimally 
close to zero and let our utility function u be the linear function defined by: 
u(xi) = e™ _l_1 , for i = 0, . . . , n — 1. Notice that X{ < Xj iff % < j. The utility 
of a mixture Xx{ + (1 — X)xj is Ae™~ 1-1 if Xj < Xj and g" -1 " 1 if ~ Xj. 

Suppose i < j and i' < j'. Then, Xxi + (1 — X)xj < \ixy + (1 — fi)xji iff 
Xj < x^ or Xi ~ Xi' and X > fi. The decision maker therefore compares differ- 
ent mixtures by comparing the worst possible outcomes and, if they are the 
same, their respective probabilities. This is some form of Maximin criterion 
and does not satisfy A2 or A3, but it has been considered a rational way 
of deciding by many authors, and it is amenable to Expected Qualitative 
Utility Maximization. 

7 Postulates for nonstandard probabilities and 
standard utilities 

The postulates that characterize this first case are Al, A3 and the following 
B2. 

Definition 2 A e]0, 1[ is negligible iff, for any p, q G P, X p + (1 — A) q ~ q. 



The intuitive meaning of negligible is infinitesimally close to zero. 
B2 p > q, A not negligible =>■ Xp + (1 — A)r > \q + (1 — A)r. 



8 Postulates for standard probabilities and 
nonstandard utilities 

The postulates that characterize this second case are Al and the following. 

To formulate our independence property, it is best to set the following 
definition. 

Definition 3 We shall say that p overrides q and write p 3> q iff p > q and 
for any q' such that q > q' and for any A e]0, 1[, Xq + (1 — X)p ~ Xq' + (1 — X)p 

The intuitive meaning of p 3> q is that p is so much preferred to q that, in 
any lottery in which p and q are the prizes, if one does not win p, one does 
not even care to cash q, but would as well get any lesser prize q'. Notice 
that, since > is asymmetric, the relation 3> is also asymmetric and therefore 
irreflexive. 

Our independence property may now be formulated as: 

A'2 p> q,r^>p VA e]0, 1 [ Xp + (1 - A)r > Xq + (1 - A)r. 

The intuitive meaning of A'2 is that any lottery is sensitive to both its prizes, 
unless one of the prizes overrides the other one. 

A'3 p> q > r =>■ 3a e]0, 1[ such that ap + (1 — a)r > q. 

A"3 p > q > r,p > q 3/5 <e]0, 1[ such that q > (3p+ (1 - 0)r. 



9 Comparison with previous work 

Numerous works during the fifties and the sixties considered weakenings of 
the von Neumann-Morgenstern's postulates. Nonstandard analysis |y| ap- 
peared late on the scene. This work proposes an original weakening based 
on nonstandard analysis. 

Our postulates are very close to the original postulates of von Neumann 
and Morgenstern. In particular the ordering < is modular (weak total) 



and the indifference relation ~ is transitive. In the case of nonstandard 
utilities, we weaken both A2 and A3, in a closely linked manner. Notice 
that A2, A'3 and A" 3 together imply A3, since A2 says that p 3> q im- 
plies that for any w, w > q. The lexicographic orderings of |3j provide one 
of the best known weakenings of von Neumann and Morgenstern's postu- 
lates. The weakening they present is essentially orthogonal to ours. In- 
deed, the lexicographic orderings define a preference relation that satisfies 
A2. Any ordering that satisfies our postulates and those of von Neumann- 
Morgenstern postulates. To explain better the difference between lexico- 
graphic orderings and our qualitative ordering (in the case probabilities are 
standard), assume P is the real plane R 2 ordered by the lexicographic or- 
dering: (x, y) < (x', y') iff either x < x' or x = x' and y < y'. For A G [0, 1], 
define X(x, y) + (1 - A)(V , y') to be (Xx + (1 - X)x', Xy + (1 - X)y'). Notice 
that (0,0) < (1,10) < (2,0), but there is no A e]0, 1[ such that (1,10) = 
A(0,0) + (1 - A)(2,0) since A(0, 0) + (1 - A)(2, 0) = (2(1 - A), 0). Both lex- 
icographic and qualitative orderings imply the failure of property P of sec- 
tion |3|. But lexicographic orderings also implies the failure of the follow- 
ing property that holds in the case probabilities are standard: if p > q > r 
and there exists some g]0, 1[ such that q > 0p + (1 — 0)r, then there exists 
some 7 g]0, 1[ such that q ~ 7p + (1 — 7)7*. Indeed there exists some g]0, 1[ 
such that (1,10) >0(2, 0) + (1 - 0){0, 0) = 0(2,0): for example = 0.4, and 
nevertheless there is no A as above. Lexicographic and qualitative orderings 
stem from different concerns and have very different characteristics. 



10 Subjective probability 

10.1 Anscombe-Aumann's framework 

In [Q , Anscombe and Aumann consider a finite set S (of states) and the set 
F (of acts) of mappings: S 1— > P. They show that a single postulate , added 
to Al, A2 and A3 is enough to characterize the orderings obtainable from 
subjective probabilities on states and linear utilities: for any a, b £ F, 

A4 If Vs G S, s 7^ s => a(s) = b(s), then a > b =>- a(s ) > b(s ). 

In the last part of A4, a(so) and b(so) stand for the corresponding constant 
functions. 



For the case of standard utilities (and nonstandard probabilities) , the same 
single added postulate is enough to guarantee the corresponding result: ex- 
istence of nonstandard subjective probabilities and a pseudo-linear utility 
function into the standard reals. 

For the case of standard probabilities (and nonstandard utilities) , in addi- 
tion to Al, A'2, A'3, A" 3 and A4, one needs an additional postulate to 
ensure the subjective probabilities are standard. This postulate deals with 
Savage-null states. 

A'5 t G S, a G F, a(t) > a t is null. 

where null is defined below and ^> is defined in Definition [3[ 

Definition 4 Let t G S. The element t is said to be null iff for any a, b G F 

we have a ~ b if a and b agree everywhere except possibly on t, i.e., for any 
s ^ t, a(s) = b(s). 

11 Conclusion 

Nonstandard models of the real numbers provide for a natural notion of 
qualitative equivalence and a principle of Qualitative Utility Maximization. 
This work characterizes in full the situation in which one allows nonstandard 
utilities but insists on standard probabilities. In this framework one may 
consider consequences that are infinitely preferable to others and criteria of 
the Maximin family. The study of games with nonstandard utilities seems 
appealing. The dual case of nonstandard probabilities and standard utilities 
and the most general case of nonstandard probabilities and utilities are yet to 
be characterized. They will include consideration of subjective probabilities 
infinitesimally close to zero. 
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